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To my father Ilya Etingof on his 80-th birthday, with admi- 
ration 

1. Introduction 

In this paper we determine the support of the irreducible spherical 
representation (i.e., the irreducible quotient of the polynomial repre- 
sentation) of the rational Cherednik algebra of a finite Coxeter group 
for any value of the parameter c. In particular, we determine for which 
values of c this representation is finite dimensional. This generalizes 
a result of Varagnolo and Vasserot, [VVj . who classified finite dimen- 
sional spherical representations in the case of Weyl groups and equal 
parameters (i.e., when c is a constant function). 

Our proof is based on the Macdonald-Mehta integral and the ele- 
mentary theory of distributions. 

The organization of the paper is as follows. Section 2 contains pre- 
liminaries on Coxeter groups and Cherednik algebras. In Section 3 
we state and prove the main result in the case of equal parameters. 
In Section 4 we deal with the remaining case of irreducible Coxeter 
groups with two conjugacy classes of reflections. In Section 5, as an 
application, we compute the zero set of the kernel of the renormalized 
Macdonald pairing in the trigonometric setting (in the equal parame- 
ter case). Finally, in the appendix, written by Stephen Griffeth, it is 
shown by a uniform argument (using only the theory of finite reflection 
groups) that our classification of finite dimensional spherical represen- 
tations of rational Cherednik algebras with equal parameters coincides 
with that of Varagnolo and Vasserot. 
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2. Preliminaries 



2.1. Coxeter groups. Let W be a finite Coxeter group of rank r with 
reflection representation ()k equipped with a Euclidean P^-invariant 
inner product (, ). Denote by f) the complexification of (jr. 

For a £ f), let W a be the stabilizer of a in VF. It is well known that W a 
is also a Coxeter group, with reflection representation t)/l) Wa = (t) Wa ) ± . 
The group W a is called a parabolic subgroup of W. It is well known that 
the subgroup generated by a subset of the set of simple reflections of 
W (which corresponds to a subset of nodes of the Dynkin diagram) is 
parabolic, and any parabolic subgroup of W is conjugate to one of this 
type. 

Denote by S the set of reflections of W. For each reflection s, pick 
a vector a s £ f)R such that sa s = —a s and (ac s , a s ) =2. Let 

A w (x) = JJ(a s ,x) 

be the corresponding discriminant polynomial (it is uniquely deter- 
mined up to a sign). 

Let di = di(W),i = 1, ...,r, be the degrees of the generators of the 
algebra C[t)} w . Let £{w) be the length of w £ W. Let 

Pw(i) = £ 

be the Poincare polynomial of W. Then we have the following well- 
known identity of Bott and Solomon: 

(i) iV(g) = n-r JL - 

If is an irreducible Coxeter group which contains two conjugacy 
classes of reflections (i.e. an even dihedral group J2(2m) or a Weyl 
group of type B n , n > 2, or F 4 ), then it is useful to consider the 
2- variable Poincare polynomial 

where is the number of simple reflections of i-th type occurring 

in a reduced decomposition of w. 

In the Weyl group case, for a positive root a, denote by lit^a), 
i = 1,2, the number of simple roots of z-th type occuring in the de- 
composition of a. 

1 As a basic reference on finite Coxeter groups, we use the book |Huj . 
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Proposition 2.1. ( |Maj ) (i) One has 

1 - gi 1 - g 2 1 - q x q 2 

(ii) For Weyl groups one has 

iV(?l,?2) - 11 - - htl(Q) ht2(Q) , 

where q a = qi if a is a root of i-th type, i = 1,2. 

From this proposition one can obtain the following more explicit 
formulas for the 2- variable Poincare polynomials of l2(2m), B n and F±. 

Proposition 2.2. ( |Maj ) One has 

Ph(2m){qi, q*) = (i + gi)(l + ga)(i + gig 2 + ... + gT'^T' 1 ), 

ra—l rt— 1 

^ n (gi, g 2 ) = II^ 1 + 9i + - + 9i) II^ 1 + ^ 2 )' 

and 

(i+gi)(i+gi+? 1 2 )(i+g 2 )(i+g2+? 2 2 )(i+^ 

2.2. Cherednik algebras. Let c be a jy-invariant function on S. Let 
H C (W, f)) be the corresponding rational Cherednik algebra (see e.g. 
[EE]). Namely, JZ^W, fj) is the quotient of C[W] x T(fj © J)) (with the 
two generating copies of f) spanned by x a ,y a , a G f)), by the defining 
relations 

[x a ,x b ] = [y a ,yb] = 0, [y a ,x b ] = (a, 6) - c s (a s , a)(a s , 6)s. 

Let M c = H C (W, I)) ®cvyKC[?/a] Q where y a act in C by and w £W 
by 1. Then we have a natural vector space isomorphism M c = C[h]. For 
this reason M c is called the polynomial representation of H C (W, f)). The 
elements y a act in this representation by Dunkl operators (see |Elj ). 

The following proposition is standard, see e.g. 



Proposition 2.3. There exists a unique VT-invariant symmetric bilin- 
ear form j3 c on M c such that /3 C (1, 1) = 1, which satisfies the contravari- 
ance condition 

f3c(y a v,v') = c (v,x a v'), v,v' e M c ,ae f). 

Polynomials of different degrees are orthogonal under C . Moreover, 
the kernel of (3 C is the maximal proper submodule J c of M c , so M c is 
reducible iff f3 c is degenerate. 
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Let L c = M c j J c be the irreducible quotient of M c . The module L c 
is called the irreducible spherical representation of H C (W, I)). 



3. The main theorem - the case of equal parameters 

3.1. Statement of the theorem. The goal of this paper is to deter- 
mine the support of L c as a C[h]-module. We start with the case when 
c is a constant function. We will assume that c G (Q\Z) >0 ; otherwise, 
it is known from [DJOJ that M c is irreducible, so L c = M c , and the 
support of L c is the whole space f). Let m be the denominator of c 
(written in lowest terms). 

Theorem 3.1. A point a G f) belongs to the support of L c if and only 
if 

^(e 27ric )^0, 

i.e., if and only if 

#{i\m divides di(W)} = #{i|m divides di(W a )}. 

Remark 3.2. The equivalence of the two conditions in Theorem 13.11 
follows from the Bott-Solomon formula ([I]) for Pyj. 

p 

Corollary 3.3. L c is finite dimensional if and only if (e 2mc ) = 0, 

Pw 

i.e., if and only if 

divides di(W)} > #{i|m divides di(W')}, 
for any maximal parabolic subgroup W C W . 

We note that Varagnolo and Vasserot |W| proved that if W is a 
Weyl group then L c is finite dimensional if and only if there exists 
a regular elliptic element in W of order m (i.e. an element with no 
eigenvalue 1 in f) and an eigenvector v not fixed by any reflection, see 
|Sp| ) . A direct uniform proof of the equivalence of this condition to the 



condition of Corollary 13. 3^ based solely on the theory of finite reflection 
groups, is given in the appendix to this paper, written by S. Griffeth. 

Remark 3.4. If W is a Weyl group, then the values of the denominator 
m of c > for which L c is finite dimensional are listed in |Wj . Let us 
list these values in the noncrystallographic cases. 

For dihedral groups ^{p)'- m > 2 is any number dividing p (this 
follows from the paper |Chm] ) . 

For H3: m = 2, 6, 10 (this is due to M. Balagovic and A. Puranik). 

For H4. m is any divisor of a degree of H^, i.e. m — 2, 3, 4, 5, 6, 10, 12, 15, 20, 30. 

3.2. Proof of Theorem SHI 



3.2.1. Tempered distributions. Let 5(IR n ) be the set of Schwartz func- 
tions on M n , i.e. 



This space has a natural topology. 

A tempered distribution on W 1 is a continuous linear functional on 
5(lR n ). Let 5'(R n ) denote the space of tempered distributions. 

We will use the following well known lemma (see [HJ). 

Lemma 3.5. (i) C[x] e - x2 / 2 C S(W l ) is a dense subspace. 

(ii) Any tempered distribution £ has finite order, i.e., 3N = iV(£) 
such that if / G S(R n ) satisfies f = df = ■ ■ ■ = d^" 1 / = on supp£, 
then (£,/) = 0. 

3.2.2. The Macdonald-Mehta integral. The Macdonald-Mehta integral 
is the integral 



It is convergent for Re(c) < 0. 

The following theorem gives the value of the Macdonald-Mehta in- 
tegral. 

Theorem 3.6. One has 

_ yr T(l - djC) 

i=i v ' 

This theorem was conjectured by Macdonald and proved by Opdam 
|Q1] for Weyl groups and by F. Garvan (using a computer) for H 3 and 
if 4 (for dihedral groups, the formula follows from Euler's beta integral). 
Later, a uniform and computer-free proof for all Coxeter groups was 
given in [E2J. 




3.2.3. The Gaussian inner product. Let a% be an orthonormal basis of 
h, and f = 5^^.. Introduce the Gaussian inner product on M c as 
follows: 

Definition 3.7. The Gaussian inner product 7 C on M c is given by the 
formula 



This makes sense because the operator f is locally nilpotent on M c . 



S(R n ) = {f E C°°(M n )|Va,/3,sup|x Q a /3 /(x)| < 00}. 





j c (v,v') = /3 c (exp(f)v,exp(fy). 
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Proposition 3.8. ([Du], Theorem 3.10)0 For Re(c) < 0, one has 

7c (P,Q) = M-^ / e- x2/2 |A w (x)|- 2c P(x)g(x)dx, 
where P, Q are polynomials. 

3.2.4. Proof of Theorem \3.1[ Consider the distribution 



4c F W (J |Aw(X 



It is well-known that this distribution extends to a meromorphic distri- 
bution in c (Bernstein's theorem). Moreover, since 7 C (P, Q) is a poly- 
nomial in c for any P and Q, this distribution is in fact holomorphic 
in c G C. 

Proposition 3.9. 

supp^D = {a G M^(c) ^ 0} = {a E W^(e 2 - ic ) ^ 0} 

= {a G f)R | #{i | denominator of c divides <ij(jy)} 

= | denominator of c divides di(W a )}}. 

Proof. First note that the last equality follows from the Bott- Solomon 
formula (CD) for the Poincare polynomial, and the second equality from 
Theorem 13.61 Now let us prove the first equality. 

Look at near a G f). Equivalently, we can consider 

e c y (x + a) = ^ 7 ^|A(x + a)|- 2c 

with x near 0. We have 

A w (x + a) = ^Qa s (x + a) = JJ(a s (x) + a s (a)) 

= J | a fl (x) • [ [ (a s (x) + a, (a)) 

= A ff .(x)-G(x), 
where G is a nonvanishing function near (since a s (a) ^ if s 

snwg. 

So near 0, we have 

er(x + a) = ^(c)-e(x)-|G(x)|- 2c , 



2 A proof of this theorem can also be found in [ESQ] (Proposition 4.9). 



and the last factor is well defined since G is nonvanishing. Thus £^(x) 
is nonzero near a if and only if -pr*(c) 7^ 0, which finishes the proof. □ 

Now consider the support of L c . Note that f) has a stratification by 
stabilizers of points in W, and by the results of [GiJ (see also [BEJ), 
the support of L c is a union of strata of this stratification. 

Proposition 3.10. For any c G C, 

supp(C W ) = (suppL c ) R , 
where the right hand side denotes the set of real points of the support. 

Proof. Let a suppL c and assume a G supp^. Then we can find 
a P G J c = ker7 c such that P(a) 7^ 0. Pick a compactly supported 
test function G C^°(^r) such that P does not vanish anywhere on 
supp0, and (C^, (ft) 7^ (this can be done since P(a) 7^ and ^ ls 
nonzero near a). Then we have <j)/P G 5({Jk). Thus from Lemma l3~5T i) 
it follows that there exists a sequence of polynomials P n such that 

P n (x)e~ x / 2 — > — in cS(F)r), when n — > 00. 

So ?P n e" x / 2 — >■ in <S(()r), when n — > 00. 

But by PropositionEll we have (^ c w , PP n e~ x ^ 2 ) = j c (P, P n ). Hence, 
(£f , PP n e- x / 2 ) = 0, which is a contradiction. This implies that 
supp^ C (suppL c ) M . 

To establish the opposite inclusion, let P be a polynomial on f) which 
vanishes identically on supp£^. By Lemma l3T5T ii). there exists iV such 
that P Ar (x)Q(x)e _x / 2 ) = 0. Thus, using Proposition 13. 8[ we see 
that for any polynomial Q, r y c (P N , Q) = 0, i.e. P N G Ker7 c . Thus, 
-P|suppL c — 0. This implies the required inclusion, since supp^ is a 
union of strata. □ 

Theorem 13.11 follows from Proposition 13.91 and Proposition 13.101 

4. The main theorem - the case of non-equal parameters 

4.1. Statement of the theorem. Consider now the case when W is 
an irreducible Coxeter group with two conjugacy classes of reflections. 
In this case, c = (01,02), and by e 2mc we will mean the pair ((71,(72), 
where qj = e 2mCj , j = 1, 2. 

Define a positive line in the plane with coordinates {c\, C2) to be any 
line of the form a\C\ + 0202 = b, where ax, «2 > 0, b > 0. 

Theorem 4.1. A point a G f) belongs to the support of L c if and only 
if there is no positive line passing through c on which the function 
z i-> ■jr L (e 2mz ) identically vanishes. 
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Corollary 4.2. L c is finite dimensional if and only if for every maximal 
parabolic subgroup W C W, there exists a positive line £ passing 
through c such that the function ■^ L (e 2mz ) vanishes on I. 

4.2. Computation of points c for which L c is finite dimensional. 

Let us use Corollary 14.21 to compute explicitly the set S c of points c 
for which L c is finite dimensional. The computation is straightforward 
using Propositions 12. II and 12.21 (although somewhat tedious), so we will 
only give the result. 

1. The dihedral case, J 2 (2m). In this case, the set S c is the union 
of the following lines and isolated points. 

1) The lines are C\ + c 2 = — , where r 6 N and r is not divisible by 

m. 

2) The isolated points are (y, y), where pj are odd positive integers. 
This description coincides with the one of [Chm] . 

2. The case In this case, the set S c is the union of the following 
lines and isolated points. 

1) The lines are c\ + c 2 = | and C\ + c 2 = |, where p is an odd 
positive integer. 

2) The isolated points are: 

2a: (y, y), where pi,p 2 are odd positive integers; 

2b: (y, y), where pi,p 2 are positive integers not divisible by 3; 

2c: (y, y — y) and (y — y, y), where p 2 is an odd positive integer 
and pi is a positive integer not divisible by 3; 

2d: ( 2p2 ~ pi ; 2pi ~ P2 ) , where pi,p 2 are °dd positive integers such that 
Pi + P2 is not divisible by 3. 

3. The case B n , n > 2. In this case, let c\ correspond to long 
roots. Then the set S c is the union of the following lines and isolated 
points. 

1) The lines are (n— l)ci + c 2 = |, where p is an odd positive integer. 

2) The isolated points are (-, | — r + — ), where r is a positive integer 
not divisible by n, p is an odd positive integer, and 2 < s < gcd " r n ^ is 
an integer. 

Remark 4.3. Note that in the case c\ — c 2 , we recover precisely the 
result of Varagnolo and Vasserot, |W| for W of types B n , F 4 and G 2 , 
while setting c 2 = 0, we recover their result for W of type D n . 

4.3. Proof of Theorem 14.11 First we need to formulate the appro- 
priate generalization of the Macdonald-Mehta integral. Let Si, £2 be 
the sets of reflections in W of the first and second kind, and let 

Aivj(x) = JJ(a a ,x). 

s€Sj 
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Define the Macdonald-Mehta integral with two parameters: 



F w (c u c 2 ) := (2n)- r / 2 [ e - x2 / 2 |A Wil (x)|- 2ci |A Wi2 (x)|- 2c Mx. 

As before, it is convergent for Re(cj) < 0. 

The following theorem gives the value of the two-parameter Macdonald- 
Mehta integral. 

Theorem 4.4. (i) For dihedral groups l2(2m), one has 

r(l-2c 1 )r(l-2c 2 )r(l-m(c 1 + c 2 )) 

Fw(ci ' C2) - r(i- Cl ) r(i- C2 ) r(i-(c 1 + C2 )) ■ 

(ii) For Weyl groups, one has 

t-t T(l - c Q - cihti(a) - c 2 ht 2 (a)) 
a>o 1 1 ~ Clhtl a ~ c 2 ht 2 a 



Proof, (i) follows from Euler's beta integral, and (ii) is proved in |Q1] . 

□ 

Also, we need an analog of the integral formula for the Gaussian 
form 7 C . This analog is given by the following proposition, whose proof 
is a straightforward generalization of the proof of Proposition 13.81 

Proposition 4.5. For Re(cj) < 0, one has 

7c(P,Q)= ^r'\ I e^ 2/2 |A w , 1 (x)|- 2ci |A^ 2 (x)|- 2c2 P(x)g(x)dx, 

where P, Q are polynomials. 

Now we are ready to prove Theorem 14. 11 Consider the distribution 

C = ^-^ |A w>1 (x)|-^|A^(x)|-^. 
F w {ci,c 2 ) 

As before, this distribution extends to a meromorphic distribution in 
c (by Bernstein's theorem), and since 7 C (P, Q) is a polynomial in c for 
any P and Q, this distribution is in fact holomorphic in c. 

Proposition 4.6. One has 

SUPPED = {a e W^(c)^0}. 
Proof. The proof is parallel to the proof of Proposition 13.91 □ 



Corollary 4.7. A point a £ f) K belongs to the support of if and 
only if there is no positive line passing through c on which the function 
z i-> ■p^-(e 2mz ) identically vanishes. 

Proof. The Corollary follows from Propositions 14.61 and 12.11 and Theo- 
rem H3J using the bijective correspondence between the factors in the 
product formulas for Pw{qi, Q2) in Proposition 12. II and the T-factors in 
the product formulas for Fw {01,02) in Theorem 14.41 □ 

Proposition 4.8. For any c £ C 2 , 

supp(CD = (suppL c ) K . 

Proof. Parallel to the proof of Proposition I3.10[ using Proposition 14.51 

□ 

Proposition 14.61 and 14.81 imply Theorem 14.11 

5. Application: the zero set of the kernel of the 
renormalized macdonald pairing 

As an application of the above technique, let us compute the zero 
set of the kernel of the renormalized Macdonald pairing in the trigono- 
metric setting (in the equal parameter case). 

Let R be a reduced irreducible root system of rank r, W be the 
Weyl group of R, R + a system of positive roots, P the weight lattice 
of R, and H = Hom(P, C*) be the complex torus attached to R. Let 
f) = Lie(if). For a £ H, the stabilizer W a is a reflection subgroup 
of W which is not necessarily parabolic; such a subgroup is called a 
quasiparabolic subgroup. 

The following lemma is well known. 

Lemma 5.1. If W C W is any reflection subgroup, then -FW(<?) i s 
divisible by Pw'{q)- 

Proof. Pw/Pw is the character of the generators of the module Cff)] 1 ^' 
over C[t)} w . ' □ 

Let 

Dr= U (e a - 1) 

be the Weyl denominator of R. Let C[H] denote the algebra of regular 
functions on H. Let c £ C. Recall that the Macdonald pairing on the 
space C[H] (or C[H] W ) is defined by the formula 

(P,Q) C := [ \D R (t)\- 2c P(t)Q(t)dt, 
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where is the maximal compact subgroup of H. It is known that 
this pairing is well defined when Re(c) < 0, and develops poles when 
c > and e 2mc is a root of P w . 

For c £ C, ler d be the order of the pole of the Macdonald pairing 
at c. Define the renormalized Macdonald pairing by the formula 

(P,Q) c = \im(k-c) d (P,Q) k . 

k— >c 

This pairing is well defined and nonzero for any c. 

Moreover, it is easy to see that the kernel I c of this pairing is an ideal 
in C [.£/"]; in fact, this ideal is invariant under the trigonometric Dunkl 
operators, so the quotient ring V c := C[H]/I C is a representation of the 
trigonometric Cherednik algebra Hl Tlg (W, H) (i.e., degenerate double 
affine Hecke algebra, see |Chj . |EMj ). Our goal is to find the support 
supp(V c ) as a C[if]-module, i.e. the zero set of I c . 

The main result of this section is the following theorem. 

Theorem 5.2. Suppose that c £ Q>o- A point a £ H belongs to 
supp(V c ) if and only if the polynomial P w /P Wa takes a nonzero value 

at e 2mc . 

Proof. We have a stratification of H by stabilizers of points in W. By 
the results of |BEj . supp(VQ is a union of strata of this stratification. 
Thus, it suffices to prove the result for a £ H^. 

Consider the distribution on if K defined by the formula 



L - w 1 1 • 



This distribution is defined for all c, and up to a scalar, 

{P,Q)c=(t R ,PQ). 

Let supp(\4)R be the intersection of supp(V r c ) with Hr. 

Proposition 5.3. A point a £ belongs to supp(^ ( f) if and only if 
the polynomial Pw/Pw a takes a nonzero value at e 2ntc . 

Proof. The proof is parallel to the proof of Proposition 13.91 Namely, 
for small x £ fj^, we have 

eiV x ) = ^e(x)/(x), 

F w (c) 

where / is a nonvanishing smooth function. So the result follows. □ 

Proposition 5.4. The set supp(V c )r coincides with the support supp(^) 
of the distribution 

Proof. The proof is parallel to the proof of Proposition 13.101 □ 

n 



Theorem 15.21 follows from Proposition 13.91 and Proposition 13.101 □ 



Example 5.5. Let R be the root system of type B 2 . Then Pw{q) = 
(l+g) 2 (l+g 2 ), so setting q = e 2mc , we see that at c = 1/2 (i.e. q = —1), 
the only points a G H = (C*) 2 for which Pw/Pw a does not vanish at 
q are (1, 1) (W a = W) and (-1, -1) (W a = Z 2 x Z 2 , P Wa = (1 + q) 2 )- 
So the support of V c is the set consisting of these two points. 

This example shows that unlike the rational case, the module V c is 
not necessarily irreducible. Namely, local analysis near the two points 
of the support using the results of [Chm] shows that V c is the direct sum 
of a 1-dimensional irreducible representation supported at (—1, —1) and 
a 4-dimensional irreducible representation supported at (1, 1). 

6. Appendix 

by Stephen Griffeth 

Let W be a finite real reflection group with reflection representation 
f). Recall that an elliptic element of W is an element not contained 
in any proper parabolic subgroup, or, equivalently, an element with fix 
space {0} in f). Recall also that a positive integer m is a regular number 
for W if there is an element g & W that has a regular eigenvector (i.e., 
one not fixed by any reflection) with eigenvalue a primitive m-th root 
of 1. (By Theorem 4.2(i) of |Sp| , in this case the order of g is m; such 
elements are called regular). If in addition this element g can be chosen 
to be elliptic, then m is called an elliptic number for W. 

Let di(W), . . . ,d r (W) be the degrees of W, and let m be a posi- 
tive integer. Denote by avy(m) the number of degrees divisible by m: 
awipi) = #{1 < i < r | m divides di(W)}. 

The purpose of this appendix is to give a uniform proof of the fol- 
lowing theorem. 

Theorem 6.1. Let W be a finite real reflection group. Then m is 
an elliptic number for W if and only if for every maximal parabolic 
subgroup W of W, one has awijn) > a W i{m). 

Proof. First suppose m is an elliptic number for W. This means that 
there exists an elliptic element h e W and a regular vector v G f) such 
that bv = (v, where ( is a primitive m-th root of unity. Assume towards 
a contradiction that aw(m) < ay/'{fn) for some maximal parabolic 
subgroup W. Then by part (i) of Theorem 3.4 of |Sp| , awijn) = 
aw'ijn), and there is an element g G W so that the ^-eigenspace of g 
has dimension exactly equal to a^(m). By part (iv) of Theorem 4.2 of 



Sp] , the elements b and g are conjugate in W. This is a contradiction, 
since b is an elliptic elememt, and g is not. 
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Conversely, assume the inequalities in the statement of the theorem 
hold. These inequalities together with Part (i) of Theorem 3.4 of Sp 



imply that for any primitive m-th root of unity £ there exists an element 
g G W with ^-eigenspace of dimension aw (m) , and the fix space of any 
such g in f) is zero (i.e., g is elliptic). Since W is a real reflection group, 
this implies that the determinant of g on f) is (— l) r (i.e., is independent 
of g). Examining the left hand side of the equation in Corollary 2.6 of 
[LM] shows that the term (— T) aw(jri "> occurs with non-zero coefficient. 
Hence, looking at the right hand side of this equation, we see that the 
number of codegrees of W divisible by m is a^(m). Now part (ii) of 
Theorem 3.1 of [LM] implies that m is a regular number, and hence 
elliptic. □ 

Acknowledgements. Stephen Griffeth acknowledges the full finan- 
cial support of EPSRC grant EP/G007632. 
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